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Abstract. Bounds consistency is usually enforced on continuous con- 
straints by first decomposing them into binary and ternary primitives. 
5^ ' This decomposition has long been shown to drastically slow down the 

fvj . computation of solutions. To tackle this, Benhamou et al. have intro- 

duced an algorithm that avoids formally decomposing constraints. Its 
better efficiency compared to the former method has already been ex- 
perimentally demonstrated. It is shown here that their algorithm imple- 
ments a strategy to enforce on a continuous constraint a consistency akin 
to Directional Bounds Consistency as introduced by Dechter and Pearl 
for discrete problems. The algorithm is analyzed in this framework, and 
compared with algorithms that enforce bounds consistency. These the- 
oretical results are eventually contrasted with new experimental results 
on standard benchmarks from the interval constraint community. 
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1 Introduction 



Waltz's seminal paper ^H] promoted the idea of local consistency enforcement to 
solve constraints. Systems of constraints were solved by considering each of them 
in turn, discarding the values in the domains of the variables involved that could 
f^ . not possibly be part of a solution. Montanari U2| and Mackworth ^J introduced 

\^ ' the notion of a network of constraints in which a more involved scheme for 

^^ . propagating domain modifications could be used. Davis ^ later adapted these 

works to solve continuous problems by employing interval arithmetic |14j to 
handle the domains of the variables. 

The first solvers to implement the ideas of Davis and others were enforcing 
on continuous constraints a relaxation of arc consistency, bounds consistency 
(aka 2B consistency jTOj), which is better suited to real domains. For practi- 
cal reasons, bounds consistency can only be effectively enforced on binary and 
^ ' ternary constraints. More complex constraints then have to be decomposed into 

such simpler constraints, thereby augmenting the number of variables and con- 
straints to eventually consider. Benhamou, van Hcntenryck, and McAUester |2] 
produced experimental evidences that such a process drastically slows down the 
computation, rendering in effect bounds consistency computation impracticable 
on many problems. They then advocated to replace bounds consistency alto- 
gether by a new consistency notion, box consistency, whose enforcement does 
not require the decomposition of complex constraints. 



However, in 1999, Benhamou et al. presented the HC4 algorithm^ 1^, which is 
strongly related to the methods employed to enforce bounds consistency except 
for its ability to handle constraints without formal decomposition. HC4 was 
shown to outperform box consistency-based solvers on some large problems; in 
addition, its use in a suitable cooperation scheme was recommended to speed 
up the computation of box consistency on difficult problems. In their paper, 
the authors did not analyze HC4 on a theoretical point-of-view. They claimed, 
however, that it would enforce bounds consistency on the system of primitive 
constraints stemming from the decomposition of a constraint containing no more 
than one occurrence of any variable. 

The contribution of this paper is to present an analysis of the HC4 algorithm 
and to compare it from the theoretical point-of-vicw with the HC3 algorithm 
used to enforce bounds consistency on decomposed constraints. We also charac- 
terize the consistency HC4 enforces on one constraint in terms of the equivalent 
on continuous domains of directional bounds consistency introduced by Dechter 
and Pearl "^j and we prove Benhamou et al.'s claim concerning it computing 
bounds consistency for constraints with variables occurring at most once. Lastly, 
we analyze experimental results to justify the discrepancy they exhibit with the- 
oretical results. 

To offer a reasonably self-content exposition, we start by recalling some def- 
initions and algorithms related to the solving of discrete Constraint Satisfaction 
Problems (CSP) in Section|2 We then adapt in Section|31the framework just in- 
troduced to the case of continuous CSPs, thus emphasizing the parallel between 
algorithms presented by Dechter [^ to enforce Directional Arc Consistency and 
the HC4 algorithm; The complexity of HC4 and HC3 are compared in Sectional 
first for one constraint only in Section 14.11 and then on a constraint system 
in Section ^21 in Sectional we contrast the theoretical results obtained in the 
previous sections with experimental results obtained on a set of standard bench- 
marks; finally, we analyze our results in Sectional and we propose some other 
interpretations of the HC4 algorithm that could lead to more efficient algorithms. 



2 Local Consistency Techniques for Discrete Problems 

The entities we will manipulate in the sequel of this paper are variables from 
an infinite countable set {xi, X2, ■ • ■ }, with their associated domains of possible 
values -D[xi], -D[x2], . . . , and constraints, which enforce some relation between 
variables. A constraint C on a finite set of variables S[C] — its scope — with do- 
mains D \s a. subset of the product of their domains. 

A constraint problem, P is formally characterized by a triplet (F, D, R), where 
y is a finite set of variables with domains D, and i? is a set of constraints such 
that the union of their scopes is included in V. 



^ It has come recently to our attention that an algorithm equivalent to IIC4 was 
independently discovered by Messine |12| . To our knowledge, this author did not 
study its theoretical properties, though. 



The basic step to solve a constraint problem corresponds to the inspection 
of each of its constraints C in turn and to the removal of all the values in the 
domains of the variables in S[C] that cannot be part of a solution of C. To this 
end, we need to be able to project C onto each of its variables. This notion of 
projection is formally stated below. 

Definition 1 (Projection of a constraint). Let C he a constraint, D a Carte- 
sian product of domains, and x a variable in C. The projection of C on x w.r.t. 
D is the set n{C,D,x) of values in D[x\ that can he extended to a solution of 
C inD. 

A projection is then the set of consistent values of a variable relative to a 
constraint. The well-known arc consistency property jllj demands that all values 
in a domain be consistent. This property is clearly too strong for our purpose 
since it has no practical counterpart for continuous domains in the general case. 
We will then only consider a weaker consistency notion that restricts itself to 
the bounds of the domains: bounds consistency. 

Definition 2 (Bounds consistency). Given C a constraint, D a Cartesian 
product of domains, and x a variable in S[C], x is said bounds consistent w.r.t. 
C and D[x\ if and only if the following property holds: 

min(i:>[x]) e n{C,D,x) A max(L>[x]) G n{C,D,x) 

A constraint C is said bounds consistent w.r.t. a Cartesian product of domains 
D if and only if every variable x in its scope is bounds consistent relative to C 
and D[x\. A constraint system is bounds consistent w.r.t. D if and only if each 
of its constraints is bounds consistent w.r.t. D. 

Solving a constraint problem P means computing all tuples of the product 
of domains that satisfy all the constraints. The general algorithm is a search 
strategy called backtracking. The computation state is a search tree whose nodes 
are labelled by a set of domains. The backtracking algorithm requires a time 
exponential in the number of variables in the worst case. Its performances can 
be improved with local consistency enforcement to reduce the domains prior 
to performing the search. For instance, the domain of a variable x that is not 
bounds consistent relative to a constraint C can be reduced by the following 
operation: 

ReviseBounds(C, D, x) = [min(i:>[x] n7T(C, D, x)),\naoi{D[x] nn{C, D, x))] (1) 

The consistency of a constraint network is obtained by a constraint propa- 
gation algorithm. An AC3-like algorithm ^] is given in Table ^ where the 
"ReviseBounds(C, D)" operation applies ReviseBounds as given by Eq. Q) on 
each variable in S[C] in an arbitrary order. 

Proposition 1 (Worst-case for BOUNDS-CONSISTENCY HHI). Given 
m the number of constraints to consider, d the size of the largest domain, k the 



maximum number of variables in any constraint, and 7 the cost of revising a con- 
straint (that is, the number of projections to apply), BOUNDS-CONSISTENCY 
incurs a cost of the order 0(mkd'y) in the worst case to achieve bounds consis- 
tency. 

Table 1. Computation of a bounds consistent constraint problem 

Algorithm: BOUNDS-CONSISTENCY 

Input: a constraint problem P = [V, D, R) 

Output: a bounds consistent equivalent constraint problem 

1. y '^R 

2. while ^ / do 

3. C ^ choose an element of ,5^ 

4. D' ^ ReviseBounds(C, D) 

5. foreach Xi s.t. D'fsi] C D[xi\ do 

6. y '^ y vj {C \ C e R h X, e S[C']} 

D[x,]'^D'[xi\ 

8. endfor 

9. ,5^ '^ ,S^\ {C} % ReviseBounds is idempotent 
10 endwhile 

As noted by Dechter [3], it may not be wise to spend too much time in 
trying to remove as many inconsistent values as possible by enforcing a "perfect 
arc consistency" on each constraint with Alg. BOUNDS-CONSISTENCY. It may be 
indeed more efficient to defer part of the work to the search process. 

The amount of work performed can be reduced by adopting the notion of di- 
rectional consistency [H], where inferences are restricted according to a particular 
variable ordering. 

Definition 3 (Directional bounds consistency). Given a Cartesian product 
of domains D, a constraint system R is directional bounds consistent relative 
to D and a strict partial ordering on variables if and only if for every variable 
X and for every constraint C G R on x such that no variable y of its scope is 
smaller than x, x is bounds consistent relative to C and D[x]. 

A propagation algorithm for directional bounds consistency, called DBC, 
is presented in Table El It is adapted from Dechter's directional consistency 
algorithms. We introduce a partition Fi, . . . ,rq of the set of variables V that 
is compatible with the given partial ordering "-<" : two different variables x and 
y, such that x precedes y {x ^ y), must belong to two different sets Fi and Fj 
with i < j. The worst case complexity for Alg. DBC is 0{km) revisions, with 
the same notations as in Prop.^ 

3 Directional Bounds Consistency and HC4 

In this section, we first adapt the framework presented in the previous section 
to the case of continuous CSPs, and we then show that the revising procedure 
for the IIC4 algorithm enforces a directional bounds consistency. 



3.1 Bounds Consistency on Continuous Domains 

The definition for bounds consistency iias to be sliglitly adjusted wlien one con- 
siders continuous domains since we cannot handle real numbers with perfect 
exactness on computers. We then restrict ourselves to real domains from a set I 
represented by intervals whose bounds are representable numbers (floating-point 
numbers). The size of a domain is then equal to the number of floating-point 
numbers it contains. We also introduce an approximation function hull to ma- 
nipulate real relations, defined by: hull(/9) = (^{B G I" | p C B}, for all p C R". 

Table 2. Computation of a directional bounds consistent constraint problem 

Algorithm: DIRECTIONAL-BOUNDS-CONSISTENCY (DBC) 
Input: - a constraint problem P — [V, D,R) 

- a strict partial ordering -< over V 

- an ordered partition A, • • • , ^g oi V compatible with -< 
Output: a directional bounds consistent equivalent constraint problem 

for i = g downto 1 do 

foreach C e R such that T, C S[C] and S[C] C A U ■ ■ ■ U T, do 
foreach x € S[C] ~ Ti do 

D[x] ^- ReviseBounds(C, -D, a;) 
endfor 
endfor 
endfor 

The definition for bounds consistency then becomes: 

Definition 4 (Continuous bounds consistency). Given C a constraint, D 
a Cartesian product of domains, and x a variable in S[C], x is said bounds 
consistent w.r.t. C and D[x\ if and only if the following property holds: 

WL\n{D[x]) e hul\{n{C,D,x)) A niax(L>[x]) e hu\l{n {C , D , x)) 

A constraint C is said bounds consistent w.r.t. a Cartesian product of domains 
D if and only if every variable x in its scope is bounds consistent relative to C 
and D[x\. A constraint system is bounds consistent w.r.t. D if and only if each 
of its constraints is bounds consistent w.r.t. D. 

As a tribute to legibility, bounds consistency will be used from now on as a 
shorthand for continuous bounds consistency. 

3.2 HC3revise: a Revising Procedure for Bounds Consistency 

According to Def. ^ the enforcement of bounds consistency on a real constraint 
requires the ability to project it on each of its variables and to intersect the 
projections with their domains. 

In the general case, the accumulation of rounding errors and the difficulty to 
express one variable in terms of the others will preclude us from computing a pre- 
cise projection of a constraint. However, such a computation may be performed 



for constraints involving no more than one operation (+, x, cos, ■■■), which 
corresponds to binary and ternary constraints such as x x y = z, cos(a;) = y, . . . 

As a consequence, complex constraints have to be decomposed into conjunc- 
tions of binary and ternary constraints (the primitives) prior to the solving 
process. 

Enforcing bounds consistency on a primitive is obtained through the use 
of interval arithmetic |14j . To be more specific, the revising procedure for a 
constraint like C: x + y = z is implemented as follows: 



D[x]^D[x]n{D[z]eD[y]) 
D[y]^D[y]n{D[z]QD[x]) 
D[z] ^ D[z] n {D[x] © D[y]) 



{ReviseBounds(C, D, x) : 
ReYiseBounds{C, D,y): 
ReviseBounds(C, D, z) : 
where and ® are interval extensions of the corresponding real arithmetic 
operators. 

Enforcing bounds consistency on a constraint system is performed in two 
steps: the original system is first decomposed into a conjunction of primitives, 
adding fresh variables in the process; the new system of primitives is then han- 
dled with the BOUNDS-CONSISTENCY algorithm described in Table[ll where 
the ReviseBounds procedure is performed by an HC3revise algorithm for each 
primitive. 

3.3 HC4revise: a Revising Procedure for Directional Bounds 
Consistency 

The HC4 algorithm was originally presented by its authors ^ as an efficient 
means to compute bounds consistency on complex constraints with no variable 
occurring more than once (called admissible constraints in the rest of the paper) . 
It was demonstrated to be still more efficient than HC3 to solve constraints 
with variables occurring several times, though it was not clear at the time what 
consistency property is enforced on any single constraint in that case. 

To answer that question, we first describe briefly below the revising procedure 
HC4revise of HC4 for one constraint C as it was originally presented, that is in 
terms of a two sweeps procedure over the expression tree of C . We will then 
relate this algorithm to the ones presented in Section [21 

To keep the presentation short, the IIC4revise algorithm will be described 
by means of a simple example. The reader is referred to the original paper PP 
for an extended description. 

Given the constraint C : 2x — z — y^ , IIC4revise first evaluates the left-hand 
and right-hand parts of the equation using interval arithmetic, saving at each 



node the result of the local evaluation (see Fig. 1(a) I. In a second sweep from top 



to bottom on the expression tree (see Fig. 1(b) I, the domains computed during 
the first bottom-up sweep are used to project the relation at each node on the 
remaining variables. 

Given the constraint set Ac — {2x — ai,y^ — a2,z — a2 — 0:3, ai — as} 
obtained by decomposing C into primitives, it is straightforward to show that 
HC4revise simply applies all the ReviseBounds procedures in Ac in a specific 
order — induced by the expression tree of C — noted ojc in the sequel. 



(a) Forward sweep (b) Backward sweep 

Fig. 1. HC4revise on the constraint 2x ~ z ~ y^ 

To be more specific, HC4revise first applies tlie ReviseBounds procedure 
for the right-hand variable of all the primitives up to the root, and then the 
ReviseBounds procedures for the left-hand variables: 
HC4revise(C, D) = 



ReviseBounds(2a; 
ReviseBounds(y^ : 
ReviseBounds(z — 
ReviseBounds(ai 
ReviseBounds(Q;i 



= a2,D,a2) 
= ^3,-0, ai) 



6. ReviseBounds(2x = ai, D, x) 

7. ReviseBounds(2: — a2 = as, -D, z) 

8. ReviseBounds(2: — a2 = 03, Z?, a^) 

9. ReviseBounds(j/^ = ct2,D, y) 



Note that, so doing, the domain of each fresh variable introduced by the decom- 
position process is set to a useful value before being used in the computation of 
the domain of any other variable. 

For admissible constraints, the HC4revise algorithm can be implemented us- 
ing the DBC algorithm by considering two well-chosen partitions of the set of 
variables of the decomposed problem. Non-admissible constraints need being 
made admissible by adding new variables to replace multiple occurrences. The 
partitioning scheme is given by tree traversals as follows: The first partition F 
is obtained by a right-to-left preorder traversal of the tree where visiting a node 
has the side effect of computing the set of variables associated with its children. 
The underlying strict partial ordering of the variables is such that a child is 
greater than its parent. The second partition F' is obtained by inverting the 
partition computed by a left-to-right preorder traversal of the tree where the 
visit of a root node associated with a variable x just computes the set {x}. The 
underlying strict partial ordering is such that a child is smaller than its parent. 
HC4revise is equivalent to applying DBC on F and then on F' . 

Going back to our example, let us consider the CSP P — [V^D^Ac), with 
V — {x,y,z,ai,a2,az}, D = D[x] x D[y] x D[z] x D[ai] x D[a2] x D[a3], and 
Ac defined as above. Let us also consider a dummy fresh variable ao supposed 
to be in the scope of the constraint represented by the root node and its children 
(«! = as), which is only introduced to initialize the computation of projections^. 
The partitions used to apply HC4revise on P by using Alg. DBC are then as 
follows: 

r = {ao}, {ai, as}, {z, 02}, {y}, {x} 

r' = {y}, {a2}, {z}, {as}, {x}, {ai}, {ao} 

^ Alternatively, the constraint ai = Q3 could be replaced by the equivalent one a\ — 
Q3 = ao, with ao constrained to be equal to 0. 



Let 7c7 (resp. 7^) be the partial ordering induced by F (resp. F') on the 
variables. With its two sweeps on a tree-shaped constraint network, HC4revise 
appears very similar to Dechter's ADAPFIVE-TREE-CONSISFENCY algo- 
rithm p. 265]. More importantly, the constraint network processed by Alg. 
DEC being a tree, we can state a result analogous to the one stated by Freuder jT] 
for arc consistency, which says that, on tree-shaped constraint networks, a bottom- 
up sweep followed by a top-down sweep are all it takes to enforce bounds con- 
sistency: 

Proposition 2 (Consistency enforced by HC4revise). Given C a con- 
straint and D a Cartesian product of domains for the variables in S[C], let 
Ac be the set of primitive constraints obtained by decomposing C. We have: 

1. Ac is directional bounds consistent w.r.t. 7^ and D" = HC4revise(C, 13); 

2. if C is an admissible constraint, the constraint system represented by Ac is 
bounds consistent w.r.t. D" = HC4revise(C, D). 

Proof. Let F and F' be two partitions for the variables in V — Uc'e/i S[C'] 
defined as described above. As stated previously, we have HC4revise(C, D) = 
BBCiiV, D', Ac),ic, n, where D' - DBC((F, D, Ac),jc, F). 

Fhe first point follows directly from this identity. To prove the second point, 
let us consider the set Flc of projection operators implementing the ReviseBounds 
procedures for the primitives in Ac. The HC3 algorithm applied on Ac and 
D would compute the greatest common fixed-point T included in D of these 
operators, which is unique since they all are monotonous '31. By design of HC3, 
Ac is bounds consistent w.r.t. T. 

Consider now HC^revise called on C and D, which applies each of the oper- 
ators in lie once in the order uc .' 

— either it computes a fixed-point of He, which must be the greatest fixed-point 
T, by unicity of the gfp and by contractance of the operators in Flc, 

— or, it is possible to narrow further the domains of the variables by apply- 
ing one of the operators in lie. Let tti : /3i <— fi{P2, ■ ■ ■ ,Pk) be this opera- 
tor. Consider the case where tti is an operator applied during the bottom-up 
sweep. According to the order ujc, '"'2'- P2 ^ /2(/3i, /Sa, ■■•, /3fc ),..., tt^ : Pk ^ 
/fc(/3i, . . . , Pk-i) have then been applied during the top-down sweep, that is, 
after having applied tti . The constraint C being admissible by hypothesis, each 
variable occurs in only one node in the tree, and then, P2, ■ ■ ■ , Pk cannot have 
been modified after having applied 7r2, . . . , Tr^. Consequently, reapplying tti af- 
ter the two .sweeps cannot narrow down /3i further, since its most up-to-date 
value has already been used to compute the current domains for (32, ■ ■ ■ , Pk 
and TTi is idempotent J^. We may then conclude that no operator applied 
during the bottom-up sweep needs to be reapplied. We can use the same ar- 
guments for an operator tti that was first applied during the top-down .sweep. 
As a consequence, no operator in lie needs being reapplied, which contra- 
dict our hypothesis that we had not reached a fixed-point. As said above, if 
HC4revise computes a fixed-point, it is necessarily the greatest common fixed- 
point T included in D of the operators in lie , ^.i^d then bounds consistency 
has been enforced on Ac. □ 



4 Theoretical Analysis of HC4 vs. HC3 

The experimental results given in Benhamou et al.'s paper ^ as well as in 
Section O below clearly exhibit the superiority of HC4 versus HC3 to solve large 
constraint problems. We present in this section the theoretical analysis of these 
two algorithms. 

4.1 Applying HC3 and HC4 to One Constraint Only 

In this section as well as in the next, we will consider the projection of a primitive 
constraint onto a variable as the atomic instruction whose count will serve to 
characterize the efficiency of the algorithms analyzed. 

Let us determine the number of projections to apply in the worst case to 
enforce bounds consistency on a single admissible constraint (not necessarily 
primitive). Given a constraint C and its decomposition Ac into p primitives, let 
k be the maximum arity of Ac defined by fc = m&yic'^Ac arity(C"). 

Let o be the number of nodes in the expression tree of C . It is easy to observe 
that o and p arc of the same order (more precisely, we have o/p ~ k) . 

Proposition 3 (Worst-case for HC4 on one constraint). HC4 enforces 
bounds consistency on the system Ac of constraints originating from an admis- 
sible constraint C that is decomposable into p primitives in 0{p) projections. 

Proof. As stressed in the previous section, the tree-shaped constraint network 
composed naturally by the constraints in Ac implies that HC4 will enforce bounds 
consistency on Ac once its two sweeps complete. The number of projections 
applied is then equal to the p evaluations during the forward sweep plus the 
projections on the remaining variables for each primitive constraint during the 
backward sweep, that is at most {k — \)p. Overall, the number of projections 
for HC4revise to enforce bounds consistency is then at most p + {k ~ l)p = kp 
projections. D 

Proposition 4 (Worst-case for HC3 on one constraint). HC3 enforces 
bounds consistency on the system Ac of constraints originating from an admis- 
sible constraint C that is decomposable into p primitives in OijP') projections. 

Proof. From Prop. \^ we know that bounds consistency is obtained when the 
information represented by the domain of each variable (both the user's ones as 
well as the fresh ones introduced by the decomposition process) is passed to all the 
other variables in the tree of C . An efficient way to do that indeed corresponds 
to Alg. HC^revise. Since the tree contains at most a variables, there are at most 
o{o — 1) informations to exchange. Considering an algorithm like BOUNDS- 
CONSISTENCY, each time a primitive is considered, at least one information 
is transfered from one variable to the others in its scope (which does not imply 
necessarily any modification in the associated domains). We then obtain at most 
o{o — 1) calls to primitives. Using the fact that a and p are related by k, and 
that each primitive requires applying at most k projections, with k a constant, 
the result follows. D 



Relating the worst-cases for HC3 and HC4, we obtain that the ratio HC3/HC4 
is of order p for one constraint in the worst case. 

4.2 Applying HC3 and HC4 on a Constraint System 

Given a system R of m admissible constraints on n variables a;i, . . . , x„, let d be 
the size of the largest initial domain. Given An the constraint system obtained 
from decomposing the constraints in R into primitives, let k be the maximum 
arity of Aji. 

As said before, Alg. HC4 enforces bounds consistency on Aj^ by applying 
Alg. DIRECTIONAL-BOUNDS-CONSISTENCY on each constraint in R twice 
every time. We stress again that bounds consistency is eventually computed only 
because we consider admissible constraints in R, that is, constraints containing 
no variable occurring more than once. 

Proposition 5 (Worst-case for HC4). The number of projections to apply to 
achieve bounds consistency with HC4 on a constraint system Aj^ obtained from 
a set R of m admissible constraints on n variables is of the order 0{mndp) in 
the worst case. 

Proof. The number of constraints to consider is m; as shown in Prop. the 
cost to apply HC^revise is of the order 0{p), with p the maximum number of 
primitives necessary to decompose each constraint in R. The result then follows 
directly from Prop. Q D 

Proposition 6 (Worst-case for HC3). The number of projections to apply to 
achieve bounds consistency with HC3 on a constraint system Afi obtained from 
a set R of m admissible constraints on n variables is of the order 0{mpd) in the 
worst case. 

Proof. First, we must note that the number of constraint to consider is no longer 
m but at most mp, since each constraint has to be decomposed beforehand. The 
maximum cost of applying HCSrevise on a constraint is k (we apply each pro- 
jection once). Each constraint can only be reinvoked at most kd times. Using 
Prop.^ we obtain a worst-case estimate ofmpkdk, with k a constant. D 

Relating the costs of computing bounds consistency with either HC4 or HC3, 
we now obtain HCS/HCA ~ mpd/{mndp), that is, HC3/HCA ^ 1/n, which 
means that the relation is now inverted compared with the case of one admissible 
constraint only. We then have that the ratio HCA/HC3 is of the order of the 
number of variables in the problem in the worst-case. As we will see in the next 
section, this pessimistic result is contradicted by all experimental results. It is 
however easy to get an intuitive understanding of it if one considers that, in the 
worst case, HC4revise may be called for a constraint each time only one value is 
removed from the domains of the variables in its scope. Using HC4revise leads 
to considering p times less constraints than with HCSrevise, since the original 
constraints do not have to be decomposed. However, HC4revise is p times more 



costly to apply than HCSrevise. Overall, HC4 is then penalized by the number 
of opportunities to reinvoke HC4revise, of the order nd (vs. kd for HCSrevise in 
HC3). Note also that, considering Prop.Elfor a system of only one constraint, we 
obtain that the number of projections to apply is of the order 0{pd) vs. 0{p^) if 
we consider Prop. 01 This contradiction is only apparent since, if d < p, the 0{p^) 
result is clearly pessimistic since it is not possible to apply p^ projections (there 
are not enough values to discard overall), and if d > p, 0{pd) is pessimistic since 
at most p^ calls suffice to broadcast the information contained by each node in 
the tree-shaped network of the constraint. 

5 Experimental Results 

We present the results of both HC4 and HC3 on four standard benchmarks from 
the interval constraint community. They were chosen so as to be scalable at 
will and to exhibit various behaviours of the algorithms. As a side note, it is 
important to remember that these algorithms are often outperformed by other 
algorithms. Their study is still pertinent, however, since they serve as basic 
procedures in these more efficient algorithms. 

It is important to note also that, originally, none of these problems is ad- 
missible. In order to show the impact of admissibility, we have factorizcd the 
constraints of one of them. 

All the problems have been solved on an AMD Athlon 900 MHz under Linux, 
using a C-f-|- interval constraint library written for our tests based on the gaol^ 
interval arithmetic library. In order to avoid any interference, no optimization 
(e.g., improvement factor) was used. 

For each benchmark, four different methods have been used: 

— HC3, which enforces bounds consistency on the decomposed system; 

— HC3sb, which uses S-boxes 0: each user constraint C is decomposed into a 
separate set of primitives and gives rise to a ReviseBounds procedure RBc 
that enforces bounds consistency on this set by using HCSrevise procedures 
for each primitive, and propagating modifications with Alg. Q] All the RBc 
methods for the constraints in the user system are then handled themselves 
by Alg.n This propagation scheme forces consistency to be enforced locally 
for each user constraint before reconsidering the others; 

— HC4, which enforces a directional bounds consistency (and not bounds con- 
sistency, since the constraints are not admissible) on each constraint using 
HC4revise, and which uses Alg. ^ for the propagation over the constraints 
in the system; 

— HC4sb, which uses one S-box per user constraint. As a consequence, HC4revise 
is called as many times as necessary to reach a fixed-point for any non- 
admissible constraint. 

Each graphics provided (see Fig.|2Jl displays the computation time in seconds 
required to find all solutions up to an accuracy of 10^* (difference between the 
lower and upper bounds of the intervals) for each method. 

^ Interval C+-I- library available at|http: //sf .net/projects/gaol/l 



The bratu constraint system modelizes a problem in combustion theory. It 
is a square, sparse and quasi-Unear system of n + 2 equations: 

V/c e {1, . . . , n} : Xk^i - 2xk + Xk+i + ex.p{xk)/{n + 1)^ = 0, 

2^0 = Xn+l = 0, 

ViG {!,..., n}: a;, e [-10^10*^] 

The largest number of nodes per constraint is independent of the size of the 
problem and is equal to 12 in our implementation. 
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Fig. 2. Solving times in seconds for all benchmarks 

As already reported by Benhamou et al. [T], HC4 appears more efficient 
than HC3 to solve all instances of the problem, and its advantage grows with 
their size. Localizing the propagation does not seem a good strategy here, since 
HC3sb and HC4sb both perform poorly in terms of the number of projections 
computed^. Interestingly enough, IIC4sb is faster than IIC3 while it requires 

* Due to lack of space, all the graphics corresponding to the number of projections 
have been omitted. They are available at the url given at the end of Section |S| 



more projections. The first reason for this discrepancy that comes to mind is 
that the "anarchic" propagation in HC3 has a cost much higher in terms of 
management of the set of constraints to reinvoke than the controlled propagation 
achieved with HC4sb (sec below for another analysis). 

The broyden-banded problem is very difficult to solve with HC3, so that we 
could only consider small instances of it: 

Vfc e {1, . . . ,n} : Xfe(2 + 5x1) + 1 - Y.,e.h ^j(l + ^j) = ^ 

with Jk = {j \ j i= k A max(l, i — 5) ^ j ^ min(ri, i + 1)}, 
Xk G [-108, +108] 

Contrary to bratu, the number of nodes in the constraints is not independent 
of the size of the problem. It follows however a simple pattern and it is bounded 
from below by 16 and from above by 46. 

As with bratu, the efficiency of HC4 compared to HC3 is striking, even on 
the small number of instances considered. Note that, here, HCSsb is better than 
HC3. On the other hand, HC4 is stiU better than HC4sb. 

The more-cosnard problem is a nonlinear system obtained from the dis- 
cretization of a nonlinear integral equation: 
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V/ce{l,...,n}: 

+ 1)2]=0 

The largest number of nodes per constraint grows linearly with the number 
of variables in the problem. 

HC4 allows to solve this problem up to 1000 times faster than HC3 on the 
instances we tested. An original aspect of this benchmark is that localizing the 
propagation by using S-boxes seems a good strategy: HC3sb solves all instances 
almost as fast as HC4 (see the analysis in the next section). Note that, once 
again, though the number of projections required for HC3sb is almost equal to 
the one for HC4, there is still a sizable difference in solving time, which again 
might be explained by higher propagation costs in HC3sb. 
Lastly, the Feigenbaum problem is a quadratic system: 
'Vfc e {l,...,n}: a;fe G [0,100], 

Vfc e {1, . . . , n - 1} : - 3.84x2 ^ 3 84a;;, - Xk+i = 0, 
-3.84a;2 + 3.84a;„ -xi^Q 

The largest number of nodes per constraint is independent of the size of the 
problem. It is equal to 10 in our implementation. 

The advantage of HC4 over IIC3 is not so striking on this problem. IIC4sb 
and HC3sb do not fare well either, at least if we consider the computation time. 

Parenthetically, the equations in the feigenbaum problem can easily be fac- 
torized so that the resulting problem is only composed of admissible constraints. 
Due to lack of space, the corresponding graphics is not presented here; however, 
we note that the solving time is reduced by a factor of more than 500 compared 
to the original version. 



6 Discussion 



Benhamou et al. :lj have tested the HC4 algorithm on many standard bench- 
marks. They have shown on each of them the superiority of HC4 over HC3. From 
the results presented in the preceding section, we have to draw the same con- 
clusions, and to reject entirely the pessimistic view conveyed by our theoretical 
analysis. 
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Fig. 3. Impact of the number of nodes per constraint on the number of projec- 
tions 

To sum up what has been observed in Sectional it appears that it is more 
efficient to deal locally with the modification of a domain induced by some 
primitive by first reinvoking the other primitives coming from the decomposition 
of the same user constraint in problems with large constraints like more-cosnard, 
while the opposite is true with systems of small constraints such as f eigenbaum 
or bratu. An intuitive understanding of that may be that the information just 
obtained by a reduction is spread and lost in a large network of primitives while 
it could be efficiently used locally to compute projections on a user constraint. 
FigureOlrelates the ratio of the number of projections required by HC3 and HC4, 
and by HC3sb and HC4sb to the number of nodes in a constraint. As one may 
see, the ratio is roughly constant for HC3 and HC4 when the number of nodes 
is independent of the size of the problem, while it increases sharply when the 
number of nodes increases with the size of the problem (e.g., more-cosnard). 
On the other hand, the ratio between HC3sb and HC4sb stays constant for 



all problems, a fact particularly striking with more-cosnard. It seems a solid 
evidence that localization of the information as obtained from using HC4 (or, 
to a lesser extent, HC3sb), is a winning strategy the larger the constraints in a 
problem are. 

Note however that HC4 is always more efficient than HC4sb on all the bench- 
marks considered. This is consistent with facts long known by numerical ana- 
lysts: we show in a paper to come that HC4 may be considered as a free-steering 
nonlinear Gauss-Seidel procedure where the inner iteration is obtained as in the 
linear case. For this class of methods, it has been proved experimentally in the 
past that it is counterproductive to try to reach some fixed-point in the inner 
iteration. 

Benhamou et al. have shown that one successful strategy to solve difficult 
problems is to make HC4revise cooperate with the revise procedure used to 
enforce box consistency. A promising direction for future researches is to in- 
vestigate other cooperation schemes based on the analysis of the structure of 
the constraints (linear, quadratic, polynomial, . . . ) and of the constraint system 
(full, banded, . . . ), using the cooperation framework presented by Granvilliers 
and Monfroy jH] as a basis. 

For the interested reader, all the data used to prepare the figures in Sectional 
and many more are available in tabulated text format at http : //www . sciences . univ-nantes . f r/inf o/perso, 
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